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Title : IMPROVEMENTS IN DMD-BASED IMAGE DISPLAY SYSTEMS 
FIELD OF THE INVENTION 

5 

This invention relates to image display systems that employ so-called 
reflective spatial light modulators (SLMs) such as those in the form of digital 
micro-mirror devices (DMDs). In particular it relates to techniques for using 
multiple SLM devices arranged serially. 

10 

BACKGROUND OF THE INVENTION 

U.S. Patent 5,612,753 to Poradish, et al., discusses a system where the 
15 images of two SLMs are projected onto a screen. The two images are the 
same size and are fully overlapped. In this arrangement there is a one to one 
correspondence between the pixels of each SLM. The Poradish patent 
makes reference primarily to the use of this parallel SLM technique for the 
improvement in light output and mitigation of color artifacts produced by the 
20 use of a field sequential color system that usually employs a color filter wheel 
and a single SLM. 

Poradish does mention the use of parallel SLM devices for the mitigation of 
gray level contouring artifacts or increasing the dynamic range of the display, 
25 but the patent does not teach a method by which this may be accomplished. 

When SLM based projection systems are to be used for a cinematic 
presentation, it is desirable for the image quality of the system to approach 

that of the film-based projection systems commonly in use. This requires that 

30 -the : system has a high spatial resolution and that the system possesses a 

„_wide. dynamic range. - While film based systems easily produce contrast 

ranges of 1000:1 or greater, SLM based systems such as those based on 
DMDs are typically limited to contrast ranges of 500:1 or less. 
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ln particular SLM devices have a finite black level. That is, the minimum 
displayed intensity in the off state for any SLM is greater than zero. In 
circumstances found in motion picture theatres this minimum black level is 
often found to be too high and the "gray" image visible when the picture is 
5 "black" is distracting and serves to emphasize that the system is different from 
a film based projection system. 

SLM devices consist of a number of separately addressable picture elements 
or pixels in a x-y array. Different types of SLMs employ different methods for 
10 achieving a gray scale intensity control for each pixel. Some devices employ 
a continuously varying analog signal (such as reflective liquid crystal devices) 
while DMD devices employ pulse width modulation of pixel sized mirrors that 
switch between only two states, "on" and "off 1 . 

15 A DMD is essentially an array of microscopic-sized mirrors on a computer 
chip. A post that allows the mirror to tilt supports each mirror. The chip 
includes electronic circuitry for moving each mirror between on and off 
positions using an electrostatic fiekL When the. QHQ raktor ts in the on 
position light is reflected from the DMD onto a screen or other image plane. 

20 When the DMD is off the light is reflected to a "light dump" and does not reach 
the screen or image plane. 

The mirrors are individually addressable so that which mirror is on and which 
is off at any given time determines the image. A memory cell associated with 
25 each mirror stores a bit of data that determines the on or off state of the 
address signal. Each mirror is addressed with a signal that indicates whether 
or not the mirror is to be on or off and therefore whether or not light is to be 
reflected to the image plane or screen. 

30 A grayscale is obtained through a technique called binary pulse width 
modulation (PWM). 
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Under PWM, a frame interval ris divided into «time durations of 

— I — — - — , each represents a bit in a 72 -bit binary word 

2"-l 2"-l 2"-l 

* s {*A-A-a--A} ■ As a result, the value of binary word x is represented by v, 
the time duration when the mirror is on, and >>can be calculated by: 

ba 



T x = yT = T 



2" -1 



The shortest time duration represents the least significant bit (LSB) of 
the binary word, and it is called the LSB time, expressed as: 

T 

The LSB time is mainly limited by the mechanical switching time of a DMD 
10 chip. Typically, the LSB time is about 20 p,sec. Therefore, the bit-depth, or the 
number of bits in a binary word representing the intensity of each pixel in the 
image formed by the DMD, is limited by both the LSB time and the frame rate. 
For a frame rate of 24 fps, the maximum bit-depth that a DMD can support is 

77 = 11. 

15 

Each single micro mirror on a DMD chip is a reflective device, and the total 
amount of output light for a binary word x is proportional to the "on-time" T x if 
the optical switching time can be ignored. In fact, the optical switching time of 
a DMD is around 2y,s, which is about one-tenth of the LSB time, and can be 
20 neglected in the following analysis. If the input binary word x is simply 
encoded to be linear to scene brightness, then a DMD chip can be considered 
a linear device with respect to brightness. 



A simplified cross section of a single DMD mirror array is shown in figure 1 . 
25 Assume the incident light from a light source is l . The light from this source 
falls on the mirror array, and when a mirror is in the on state the light is 
reflected by the mirror with an optical pixel efficiency of a < l . The output pixel 
brightness P can be calculated by: 
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P = (ay + 8)L = ayL + L dafic 

The second item L dark =8L represents the "dark level" of a DMD. This 
corresponds to the light reflected by a pixel of the array when the associated 
5 mirror is in the off state. This dark level is the combined result of light 
diffraction from mirror edges, reflection from the underlying substrate and 
scattering from the mirror surface, particularly around the dimple formed at the 
support post location. This combined effect is modeled by a factor 8 and is 
typically: 



The "dark level" determines the contrast ratio of a DMD device. It can be 
reduced by architectural improvement to the DMD pixels, but it may not be 
completed eliminated. 

15 The simplest implementation of a PWM scheme makes the period of the most 
significant bit 1/2 of the total frame time. The period of the next most 
significant bit is 1/2 of this or 1/4 of the total and so on. 

At certain bit transitions, such as for example in an 8 bft system where the 
20 msb switches off, and the remaining bits switch on, that is the displayed code 
value switches from 1000000 binary to 01111111 binary, the temporal 
position of the associated light reflected by a pixel making this code transition 
changes from the first half of the frame interval to the second half. As a result 
temporal artifacts are produced that are found to be problematic when 
25 displaying moving images. 

These artifacts can be reduced by avoiding such transitions, and by spreading 
the time that a bit is on during the frame more uniformly throughout the frame 
duration. This is obtained for example by dividing the most significant bit into 
30 say 4 separate parts, making four equal on-off transitions for the bit during the 
frame time, yielding the same intensity, but splitting the on time into four parts 
equally spaced throughout the frame duration. Additional complexity may be 
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introduced to further smooth the transitions that occur during a gray scale 
ramp and to avoid the creation of low frequencies that are more noticeable as 
flicker in the image. 

5 Where full-color images are required, three DMDs may be used, one for- each 
primary color (RGB). The light from the DMDs converges so that the viewer 
perceives color. Another technique is to use a single DMD and a so-called 
"color wheel" having sections in the primary colors so that light incident on the 
DMD is sequentially colored RGB. The viewer's eye then integrates the 
10 sequential images into a continuous color image. 

Other types of SLMs may be similarly arranged to obtain color images. 

15 SUMMARY OF THE INVENTION 

The performance of currently available SLMs is not sufficient for creating a 
visual sensation equivalent to a film-based system. There are three issues: 
dynamic range, contrast ratio and frame rate. 

20 

The present invention is directed towards a projection system comprising a 
controller, a first reflective SLM and a second reflective SLM. The first 
reflective SLM is operatively coupled to the controller to receive first image 
data from the controller and is aligned to receive light from a light source and 
25 to reflect imaging light correlated to the first image The second reflective SLM 
is operatively coupled to the controller to receive second image data from the 
controller and is aligned to receive imaging light from the first reflective SLM 
and to reflect modified imaging light. Typically, the projection system will also 
include a light source and optical components such as a projection lens. 

30 

The invention is also directed towards a projection system comprising a 
controller and a plurality of reflective SLMs operatively coupled to the 
controller to receive image data from the controller. The reflective SLMs are 
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aligned in series to receive light from a light source and to reflect imaging light 
correlated to the image data. 

5 BRIEF DESCRIPTION OF THE DRAWINGS 

The present invention will now be described, by way of example only, 
with reference to the following drawings, in which like reference numerals 
refer to like parts and in which: 

10 

Figure 1 is a schematic diagram of a row of micro mirrors on a DMD 
illustrating the transmission of light by micro mirrors in the "on" and "off" 
positions; 

15 Figure 2 is a schematic diagram of the components of a serial DMD 

image display system made in accordance with the subject invention; 

Figure 3 is a schematic diagram of the components of a serial color 
DMD image display system made in accordance with the subject invention; 

20 

Figure 4 is a chart which shows a codebook for setting the pixel values 
of a serial DMD having two four-bit DMD arrays, made in accordance with the 
present invention and correlating the brightness levels achieved by the serial 
DMD with those of a six-bit DMD; 

25 

Figure 5 is a graph of the distribution of the codes for the serial DMD 
indicated in Figure 4, shown plotted against the six-bit DMD of Figure 4. 

30 DESCRIPTION OF THE PREFERRED EMBODIMENTS 

For SLMs such as DMDs where mechanical switching is used, the maximum 
number of bits possible with a binary PWM scheme is determined by the 
period of the LSB. For current DMD devices the minimum period of the LSB 



WO 01/69941 



PCT/CA01/00339 



-7- 

is equal to the mechanical switching time of the mirrors, which is about 20 
psec. For a frame rate of 24 fps, the period of the LSB means that a total of 
11 bits can be represented in the 41.67 msec, available for each frame. The 
number of possible bits determines the total number of steps available to 
5 represent a grayscale image, and this corresponds to the dynamic range of 
the resulting image. 

It should also be clear that increasing the frame rate reduces the time 
available for the creation of various bit durations using binary PWM, and as a 
10 result the number of bits available is reduced, as is the corresponding 
dynamic range. 

The contrast ratio of a system is limited by the maximum difference between 
the dark level of the SLM and the maximum light level that the SLM can 
15 deliver that corresponds to a full white input signal level. 

The available bit depth of 1 1 bits, or a dynamic range of 2048 steps, is inferior 
to a. film-based system which can reach an equivalent bit depth at aeady 14 
(16,383 steps) in shadow areas. The current DMD contrast ratio is about 
20 500:1, which is lower than the 1000:1 ratio required by film-based system. 
Finally, for certain applications, such as 48 fps Imax HD projection system or 
Imax 3D system using LCD alternating shutter glasses, there is a need to 
increase the frame rate of a projection system. In the case of the DMD, any 
increase in frame rate will further reduce effective bit-depth. 

25 

By placing two reflective SLMs in series the limitations of a single DMD can 
be overcome through the multiplicative effect of the two SLMs when 
displaying a grayscale. This can be better understood with reference to the 
projection system shown generally as 2 in Figure 2. 

30 

As illustrated by light ray vector 4 shown in dotted line, light source and 
reflector 10 illuminate integrator rod 12 via cold mirror 11. Relay 14 directs 
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the light 4 from 12 onto the surface of a first DMD device 16 at a suitable 
angle so that the on state light is directed through relay 18 which images the 
light from 16 onto the surface of a second DMD device 20 so that there is a 
one to one correspondence between the pixels of 16 and 20. On state light 
5 from the second DMD 20 then passes onto the projection lens (not shown) or 
other imaging system and then to the projection screen. 

As will be understood, the system 2, also includes a controller 22, operatively 
coupled to the first and second DMDs 16, 20. The controller 22 is suitably 
10 programmed to provide image data to the DMDs 16, 20. As discussed in 
greater detail below, the image data comprises pulse width modulation data 
corresponding to each micro mirror in the array of each DMD 16, 20. 

The system 2 may optionally include a color wheel 9 (shown in dotted outline) 
15 operatively coupled to the controller 22 for color display. In such a 
configuration, the image data generated by the controller 22 will include pulse 
width modulation signals correlated to and synchronized with each color on 
the color wheel (typically, fed, green and blue). 

20 As will be understood by one skilled in the art, if the optical configuration of 
the system 2 results in an inverted or reverse image, the image data provided 
by the controller 22 to the first DMD 16, will correspondingly be reversed or 
inverted. 

25 While the system 2 has been shown as incorporating two DMDs 16, 20 in 
series, it should be understood that the system 2 may include more than two 
DMDs in series, providing additional improvements in contrast levels in the 
projected images. Typically the loss of light as a result of optica) transmission 
inefficiencies limit the number of DMDs which may be aligned in series and 

30 produce acceptable results. 
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A color version of the serial SLM system of the present invention may be 
understood with reference to the color projection system shown generally as 3 
in Figure 3. 

5 As illustrated by light ray vector 4 shown in dotted line, white light source and 
reflector 10 illuminate integrator rod 12 via cold mirror 11. By using mirrors 21 
and 23, which are dichroic mirrors that selectively reflect some wavelengths of 
light and transmit others, the white light from the source 10 is divided into 
three wavelength bands, corresponding to the red, green and blue portions of 
10 the spectrum. Wavelength selectively reflecting mirror 21 reflects the red 
portion of the light from the integrator rod 12 towards relay 14A and allows the 
green and blue portion of the light to pass on towards mirrors 23 and 24. 

Relay 14A directs the red light from mirror 21 onto the surface of a first DMD 
15 device 16A at a suitable angle so that the on state light is directed through 
relay 18A which images the light from 16A onto the surface of a second DMD 
device 20A so that there is a one to one correspondence between the pixels 
of 16A and 20A. On state light from the second DMD 20A then reaches plain 
mirror 25 and is reflected towards w a veteng fr ft selective m*rrors 2fT antt 27" 
20 which pass the red light onto the projection lens (not shown) or other imaging 
system and then to the projection screen. 

In a similar manner, wavelength selectively reflecting mirror 23 directs the 
green portion of the light towards relay 14B and the components following 
25 while allowing the blue portion of the light to continue on towards mirror 24. 
Plain mirror 24 directs the blue light that remains towards relay 14C and the 
components following. 

The output of the second serial DMD system consisting of components 14B - 
30 20B is directed towards the projection lens by wavelength selective mirror 26 
which passes the red light from mirror 24 and reflects the green light from 20B 
towards the projection lens. In a similar fashion, the output of the third serial 
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DMD system 14C - 20C is directed towards the projection lens by wavelength 
selective mirror 27 which passes the red light from mirror 24 and-green light 
from mirror 25 while reflecting the blue light from 20C towards the projection 
lens. 

5 

It should also be clear that other systems of dividing the input light into color 
bands and combining the output of the serial DMD systems may be used 
without departing from the spirit of the invention. It should also be understood 
that three colored light sources with reflectors, cold mirrors and integrating 
10 rods could be used to separately illuminate the three serial DMD systems. It 
should also be understood that the system 3 is a schematic representation of 
a three color system, and those skilled in the art will recognize that additional 
optical elements may be required to allow combining the output of each color 
channel into a single projection lens or image plane. 

15 

As will be understood, the system 3 also includes a controller 22, operatively 
coupled to the three sets of first and second DMDs 16A-C and 20A-C. For 
clarity, Figure 3 only shows the operative connection between the controller 
22 Bn&1 r rst DMD f 6A : and second UM& 20A; attwugh rf wfff : be understood 
20 that similar connections exist between the controller 22 and the remaining 
DMDs 16B-C and 20B-C. The controller 22 is suitably programmed to provide 
image data to the DMDs 16A-C and 20A-C. As discussed in greater detail 
below, the image data comprises pulse width modulation data corresponding 
to each micro mirror in the array of each DMD 16A-C and 20A-C. 

25 

The operation of a serial DMD system may be further understood as follows. 
Assume that the optical efficiencies of the first and second DMDs are 
represented by a u a 2 , the "dark level" factors by 8 l9 5 2 , the output pixel 
brightness of the two serial DMDs can be described by (the serial DMD 
30 equation): 

P 2 =(a 2 y 2 +8 2 )P X 

= (a 2 y 2 +8 2 )(a l y l +8 l )L 
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= (a l a 2 y l y 2 +a 1 S 2 y 1 +«2 5 i^2 +S t S 2 )L 
= a s y l y 2 L + e s L + S s L 

5 Where Pi is the output brightness of the first DMD 16 and a*, 81 and yi are 
the optical efficiency, dark level factor and bit duration of the first DMD 16 
respectively. Similarly P 2 , cc 2 , 82 and y 2 are the optical efficiency, dark level 
factor and bit duration of the second DMD 20. 

10 Compare the serial DMD equation with the single DMD equation shown 
previously in the background section. Here the two serial DMDs have a total 
optical efficiency of a s =a,a 2 and a dark level factor of S s =5,5 2 . Since the 
optical efficiency of a single DMD is about 60% with current technology, the 
combined optical efficiency will be reduced to a s <u0.36. However, the 

15 combined dark level factor 5, will also be much lower than that of a single 
DMD. The second item e s L = a 1 S 2 y l +a 2 5 } y 2 in the serial DMD equation 
represents the cross talk between two DMDs and should be considered signal 
dependent noise. When n is large, both 5, and S 2 should be small compared 
terthe signals in the serial DMD equation and can be ignored. 

20 

If we ignore the cross talk item e s then the output brightness from two serial 
DMDs can be considered linear to the product of bit time durations yi y 2 . In 
order for the two PWM sequences of the serial DMDs to function in this 
manner the following requirements must be met: 

25 

1 . The PWM sequences of the two serial DMDs must be synchronized. 

2. Each bit duration or split bit duration of the second DMD must correspond 
to the available durations of the bits for the first DMD, that is each bit 

30 sequence of the second DMD must be illuminated by any bit sequence of 
the first DMD in order to produce the multiplicative effect of bit time 
durations for all intensities. 
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" In practice, requirement 2, above, typically limits the bit sequences of the first 
DMD to simple PWM schemes, while more complex bit splitting schemes may 
be employed with the second DMD. 

5 

In this embodiment one method for allocating the bits of a larger binary word 
between the two DMD devices is to allocate the top k most significant bits of 
each m-bit binary word to the first DMD and the balance to the second. This 
can be explained by a simple example. 

10 

Assume each DMD in a serial DMD configuration has 100% optical efficiency 
and supports « = 4 bit depth. When the first DMD produces a brightness value 
that is exactly half of the total brightness range, the second DMD will 
represent the half brightness range with 2" =2 4 =16 brightness levels. The 

15 result is equivalent to a bit depth of m = 5, effectively adding one bit to the bit- 
depth within the lower half of the brightness range. When the first DMD output 
increases to maximum brightness, the DMD will produce 2 4 =16 levels for the 
entire brightness:, range. However, since the tower hatf already has a 
representation of 16 levels, then only the top half needs additional 8 levels. 

20 The resulting coding will have total of 24 levels, with top half represented by 4 
bit-depth and lower half by 5 bit-depth. Considering human brightness 
perception actually has a near logarithmic response, this coding scheme may 
actually be more efficient than the linear coding used in a conventional single 
DMD based system. 

25 

In general, if the first DMD maintains 2 k equally spaced brightness levels, a 
serial DMD device should have a dynamic range performance equivalent to 
*+« bit depth, at least within the lowest level. In practice, due to the binary 
pulse width modulation (PWM) scheme utilized, a frame duration is not 
30 divided into 2" but 2" -l equal segments, which makes actual code design 
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more complex. In this example we select 2* levels for the first DMD, and run 
the second DMD at the full pixel depth available based on the frame rate. 

The actual code value represented by each code word will be selected based 
5 on the following two criteria: 

• Each code word x x x 2 represents an equivalent code from a k+n linear 
codebook; 

• The equivalent code value is selected by minimization of the time 
10 duration error. 

The table in Figure 4 shows a codebook for a serial DMD design using two 
devices each producing a total of 16 steps or 4 bits per pixel bit depth. The 
first DMD outputs four approximately equally spaced brightness levels. New 

15 code words are selected based on error minimization. The resulting new 
codes have 32 code words with a performance equivalent to a bit-depth of 6 
bits, as illustrated by the corresponding data on the chart. The distribution of 
the new codes is shown plotted against a true 6-bit linear code in Figure 5. 
As wffi be understood, this code design nwtfrod can be extended to actual 

20 DMD devices with arbitrary bit-depth. As will be understood, the codes listed 
on the chart in Figure 4 are not exhaustive of the various binary combinations 
available. Accordingly, different combinations of pulse width modulation or 
intensity data may be determined, to provide alternative intensity levels. 

25 While this invention has been described with reference to DMD devices, other 
reflective SLMs may be employed, particularly ones which do not rely on 
PWM techniques may be used for one or both SLMs, freeing the design from 
the code design restrictions and complexity imposed by the PWM scheme. 

30 It should also be clear to those skilled in the art that alternative arrangements 
of optical elements and SLMs other than those shown in figure 2 can be used 
to accomplish the pixel aligned serial arrangement of the two SLMs. 
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We claim: 

1 . A projection system comprising: 

5 (a) a first SLM adapted to receive light from a light source and to 

reflect modulated light; 

(b) a second SLM positioned in series with the first SLM to receive 
modulated light reflected from the first SLM and to reflect that 
light for producing an output; 

10 (c) a controller coupled to the first SLM for delivering first image 

data to the first SLM, and coupled to the second SLM for 
delivering second image data to the second SLM, said first and 
second image data being correlated to provide a viewable image 
at said output. 



15 



The projection system as claimed in claim 1 , wherein the first SLM is a 
digital micro mirror device having a first array of addressable micro 
mirrors. 



20 3. The projection system as claimed in claim 2, wherein the second SLM 
is a digital micro mirror device having a second array of addressable 
micro mirrors. 



4. The projection system as claimed in claim 3 wherein each micro mirror 
25 in the second array corresponds to a micro mirror in the first array. 



5. The projection system as claimed in claim 2, wherein the first image 
data comprises first intensity data for each micro mirror in the first 
array. 
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6. The projection system as claimed in claim 3, wherein the second image 
data comprises second intensity data for each micro mirror in the 
second array. 

5 

7. The projection system as claimed in claim 5, wherein the first intensity 
data comprises first pulse width modulation data. 

8. The projection system as claimed in claim 6, wherein the second 
10 intensity data comprises second pulse width modulation data. 

9. The projection system as claimed in claim 1, further comprising a color 
wheel operatively coupled to the controller for providing color to the 
viewable image. 

15 

1Q. The projection system as claimed in claim 1, faster comprising a nrfay 

for aligning the imaging light onto the second reflective SLM. 

11. The projection system as claimed in claim 1, further comprising a 
20 projection lens. 



12. The projection system as claimed in claims 5 and 6, wherein the first 
intensity data and the second intensity data are determined in 
accordance with a bitmap code 

25 

13. The projection system as claimed in claim 12, wherein the bitmap code 
correlates first intensity data with second intensity data. 
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14. The projection system as claimed in claim 12, wherein the bitmap code 
is formatted substantially in accordance with Figure 4. 



5 15. The projection system as claimed in claim 13, wherein the product of 
correlated first intensity data and second intensity data is substantially 
linear. 



16. The projection system as claimed in claim 13, wherein the product of 
10 correlated first intensity data and second intensity data is substantially 

curvilinear. 



17. The projection system as claimed in claim 13, wherein the product of 
correlated first intensity data and second intensity data is substantially 

15 non-uniform. 

18. The projection system as claimed in claim 13, wherein first intensity 
data and the second intensity data are determined such that adjacent 
products of correlated first intensity data and second intensity differ in 

20 quantity approximately in accordance with human ability to detect 

variations in light intensity levels. 

19. A projection system comprising: 
(a) a controller; 

25 (b) a plurality of reflective SLMs operatively coupled to the controller 

to receive image data from the controller; and 
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(c) wherein the reflective SLMs are aligned in series receive light 
from a light source and to reflect imaging light correlated to the 
image data. 

20. The projection system as claimed in claim 1 9 wherein each of the 
plurality of SLMs in series comprises a set of at least three color 
specific SLMs. 
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